Dervis van Leersum

CONTACT ME

Portfolio

A webscraper with GUI

Back

I created this tool as part of a large scale maintenance project of civil structures in Amsterdam. For this project it is essential to analyse archive data

For this project it is essential to analyse data of the existing structure to determine if the structural design is up to standard.

The data concerning all civil structures is stored by the city of Amsterdam, and in order to collect this information an account is needed (login).

Each file for each structure needs to be navigated to and selected manually in order to download. All civil structures are filed in batches of approximately 25-30 structures.

Each structure has between 20 to 200 files (drawings, calculations, maintenance, etc.). This would result in over 2500 clicks, and a lot of navigating, in order to download just a single batch of data.

This tool asks for your login, the location on your machine you want the data to be stored, the batch number and if you want to collect data from a single structure or the whole batch.

By the press of a single button, this tool will download all the files you need in the background.

Technologies: PYTHON, TKINTER, SELENIUM, REGEX

Link to the project